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Description 

[0001] The illustrative embodiments disclosed in the 
present application are useful in systems including 

those for processing forms and more particularly are 
useful in systems including those for processing forms 
using a digital pen. 

[0002] Traditional paper based forms are used in 
many situations. Typically, afomn will include pre-printed 
information and pre-printed boxes for data input. A 
salesman in the field or a customer in a store might fill 
in such a traditional fonn. In such a situation, a salesman 
or customer would fill in some information on the form 
and the form would be sent to a central processing lo- 
cation by mail or facsimile. The data on the form would 
typically be scanned or keyed in by an operator. 
[0003] In using a traditional pre-printed form, the user 
fills in data input spaces using an ink pen. The form is 
then sent for processing. Accordingly, the user may not 
be able to ascertain required infonnation and may sub- 
mit a partially filled in form. 

[0004] A reference entitled Apparatus and Method 
For Editing Electronic Documents is shown in United 
States Patent Number 5,897,648 issued April 27, 1999 
to Henderson. The reference describes a system for 
scanning in an original document and then using a dig- 
itizing pen in conjunction with the scanned document. 
[0005] The present application describes illustrative 
embodiments of systems and methods for generating 
documents such as by completing forms. In further illus- 
trative embodiments, a user utilizes a pre-printed form 
having a pre-printed identifier and a digital pen to select 
a form template identified by the identifier. In a further 
illustrative embodiment, the identifier identifies the par- 
ticular unique copy of the form as well as the form type 
and version. 

[0006] FIG. 1 A is a schematic representation of a pre- 
printed form according to an illustrative embodiment of 

the present application. 

[0007] FIG. 1 B is a partial exploded view of the sche- 
matic representation of a form according to the illustra- 
tive embodiment of the present application shown in 
FIG. 1A. 

[0008] FIG. 2 is a schematic representation of a data 
record according to an illustrative embodiment of the 
present application. 

[0009] FIG. 3 is a flow chart showing a process for 
selecting a version of a form according to another illus- 
trative embodiment of the present application. 
[0010] A method and system for identifying a media 
is shown. In an illustrative embodiment, a system and 
method for using a digital pen to trace a pre-printed iden- 
tifier in order to identify a form is shown. In one embod- 
iment, a digital pen and pre-printed serial number is 
used to determine the unique instance of a form. 
[0011] When a user is writing on a form using a digital 
pen, the back end application must already know the 
type of form being used and the layout of that form in 



order to interpret the pen strokes of the user. When a 
traditional plain paper form was used, there was no in- 
formation available to the digital pen to help identify and 
extract the fields of information written by the author. An 

5 author is a party that uses a digital pen to fill in a form. 
The form generator is the party that has created the form 
for use. A form template is developed to identify the lay- 
out of the form including the nature and location of fields 
used in the form that are to be filled in by an author. A 

10 serial number is used to identify a type of form and may 
also be used to identify a particular version of a form or 
a unique instance of a particular type of form. A digital 
pen is a pointing device that can be used to input infor- 
mation and is preferably a wireless capable pen sized 

15 device that writes using ink and detects and communi- 
cates user pen stroke data. 

[0012] In illustrative embodiments described herein, 
the application describes using a form identifier such as 
a form serial number that may be traced over and used 
20 by a back end application to identify a particular form 
being utilized. Accordingly, the back end application 
could recall a form layout in order to identify the nature 
and location of particular input fields to be used by an 
author. 

25 [0013] Digital pointing devices such as the pen and 

tablet systems available from Wacom Technology Corp. 
of Vancouver, Washington, USA, allow a user to utilize 
a computer to capture pen strokes that the user traces 
over a tablet. Digital pointing devices may utilize capac- 

30 itive sensors or other grid based sensors to determine 
absolute or relative position of the pointing device. 
[0014] Digital pens allow a user to capture or digitize 
handwriting or pen strokes that the user writes on a me- 
dium such as a piece of paper by using a processorsuch 

35 as a personal computer. Certain digital pens utilize an 
imaging device to scan or record an image of the pen 
stroke. Certain other digital pens use mechanical sen- 
sors in order to record a pen stroke. The pen systems 
may utilize positioning systems such as light-based 

40 scanning systems including infrared (ir) sources and de- 
tectors in order to determine an absolute or relative po- 
sition of the pen. Digital pen systems include the 
N-Scribe system available from Digital Ink of Wellesley, 
MA and the E-Pen system available from E-Pen InMo- 

45 tion of Matam, Haifa Israel. A digital pointing device in- 
cludes the V-Pen system available from OTM Technol- 
ogies of Herzliya Israel. 

[0015] Another digital pen system is the Sony-Erics- 
son CHA-30 Chatpen and Anoto paper available from 

50 Anoto AB of Sweden. The Chatpen typically utilizes a 
Bluetooth transceiver in order to communicate with a 
processor and the Anoto paper includes a grid encoding 
information such position information that is detected by 
the Chatpen. The pre-printed grid may be used to iden- 

55 tify a particular form, but using a unique grid for each 
form may be cumbersome. Additional information may 
be captured including information related to pressure, 
speed and pen attitude. The additional information in- 
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eludes biometric information that nnay be used to identify 
or autlienticate a user. 

[0016] A reference describing a handheld writing de- 
vice is shown in U.S. patent number 6,050,490, Issued 
April 18, 2000. 

[0017] Commonly owned, co-pending U.S. patent ap- 
plication serial number 09/727,893 and filed November 
30, 2000 describes systems for remote retrieval of mes- 
sages. 

[0018] Commonly owned, co-pending U.S. patent ap- 
plication serial number 09/707,561 , filed November 7, 
2000 describes systems for remote retrieval of docu- 
ments. 

[0019] Commonly owned, co-pending U.S. patent ap- 
plication serial number 09/728,237, filed November 30, 
2000 describes systems for remote printing of docu- 
ments. 

[0020] Reference is also made to the following com- 
monly owned, co-pending U.S. patent applications: 

application serial nnumber 10/065,281, entitled 
Method And System For Creating And Sending a 
Facsimile Using a Digital Pen, filed September 30, 
2002; 

application serial number 10/065,282, entitled 
Method And System For Creating a Document Hav- 
ing Metadata, filed September 30, 2002; 
application serial number 1 0/065,283 entitled Meth- 
od And System For Identifying a Form Version, filed 
September 30, 2002; and 

application serial number 10/065,284, entitled 
Method And System For Remote Form Completion, 
filed September 30, 2002. 

The Digital Pen 

[0021] The present application describes systems 
and methods forcomposing documents using a pointing 
device. Certain illustrative embodiments described 
herein utilize a digital pen that tracks an x-y position and 
records stroke data. A pen using an infrared transceiver 
based positioning system is utilized and the pen tip is 
sensed to detect pen strokes. The position information 
and stroke information is sent to a processor that proc- 
esses pen input. The processor (not shown) is connect- 
ed to the pen and position sensor transceiver using a 
wireless connection such as Bluetooth and is a Pentium 
4 Dell computer using Windows XP with wireless con- 
nectivity. Alternatively, a PDA such as a Casio PDA may 
be used with a wired serial interface. However, other 
sensing devices may be utilized to compose other doc- 
uments, such as a Chatpen using Anoto paper and a 
pattern lookup server. 

[0022] The digital pen is utilized to capture information 
regarding the pen strokes made by a user. In the illus- 
trative embodiments described herein, an Anoto Chat- 
pen is described in order to differentiate different forms 
using the same underlying pattern. Toolkits available 



from Anoto AB are utilized to process stroke data and 
also biometric data including stroke data. Document 
generation is accomplished using Word and VBA avail- 
able from Microsoft of Redmond, Washington, USA. Ad- 
5 ditionally, development tools and customizable applica- 
tions available from Microsoft may be utilized. In an al- 
ternative embodiment, an infrared-based digital pen is 
utilized. 

[0023] However, other digital pens may also be uti- 

10 llzed. Certain digital pens utilize position determination 
in order to determine the actual location of the pen on a 
piece of paper in order to provide a relative location in 
terms of the location in the space of the piece of paper. 
Certain digital pens scan the ink as it is applied to digitize 

15 a stroke while others sense the stroke using sensors 
such as pressure sensors, Doppler sensors, accelerom- 
eters and other sensing mechanisms. 
[0024] The Chatpen and Anoto paper provide a pen 
that writes using ink on paper printed with an Anoto pat- 

20 tern. The Chatpen includes a sensor to detect the Anoto 
pattern. The detected pattern identifies the relative pen 
location on a grid of the pattern using a pattern look-up 
processor that may be locally or remotely located. The 
relative location allows the pen stroke and pattern look- 

25 up processor to determine where the pen is on a defined 
logical space of the pattern. Certain logically defined 
two-dimensional areas of the pattern may be defined as 
representing certain functions. For example, Anoto pa- 
per may be printed with a box that includes a particular 

30 portion of the pattern that is attributed the meaning of 
"Send Form." The Anoto pattern may be utilized to de- 
termine the type of pre-printed form being utilized and 
the company that should receive the data. However, as 
described below, the Anoto pen may be used with dif- 

35 ferent forms having the same underlying pattern by us- 
ing a traceable indicator such as a form number. 
[0025] Using the Chatpen, the stroke, biometric and 
pattern position information is sent to the pen stroke 
processor via a wireless Bluetooth TM communications 

40 channel that is secure across a personal area network. 
A pattern lookup processor may be local to the docu- 
ment composition processor or may be remotely linked 
via a communications channel such as the Internet. Al- 
ternatively, an Intranet may be utilized in place of the 

45 Internet. As shown herein, a completed document or 
form is composed and delivered according to strokes 
made on a pre-printed form. 

[0026] The illustrative embodiments describe meth- 
ods and apparatus for identifying a form using a trace- 

50 able indicator such as a form number. Additional meth- 
ods for identifying a form are described. The processes 
and apparatus described may be implemented using 
hardware, software or a combination of both. The com- 
munications channels may be wireless or wired and may 

55 utilize security techniques such as encryption. The data 
storage and data processors may be locally or remotely 
located. 



3 



5 



EP 1 403 777 A2 



6 



The Paper Form 

[0027] Referring to FIG. 1 , an illustrative fornn 100 is 
used to describe an illustrative embodiment describing 
a digital pen form identification and composition service 
system. 

[0028] The Digital Pen includes a processor, memory, 
ink, a camera or image sensor, a battery and a wireless 
transceiver (not shown). It also includes biometric sen- 
sors (not shown). In an alternative, the ink is machine 
detectable. In another embodiment, the ink is invisible. 
[0029] The fonn 1 00 is identified as an Auto Loan Ap- 
plication form 102 printed on paper. Section 112 pro- 
vides instructions to the user so that the user will know 
to trace over the form number 110 using the digital pen. 
In this embodiment, the form number must be located 
in that location for every form that is processed by the 
back end application (not shown). In an alternative, the 
form recognition system may continue to process and 
store pen strokes without knowing the underlying fonn 
type until the back end application recognizes the trace 
over for a form serial number. 

[0030] The form 1 00 includes an Applicant Name field 
1 1 4, an Address field 1 1 8, a Social Security Numberf ield 
11 6, a state field 1 22 and a zip code 1 20. 
[0031] The form also includes a signature box 126 
having indicator 106 and a date input field 124 having 
an indicator 104. 

[0032] In one embodiment, the digital pen is a Chat- 
pen using a Bluetooth TM transceiver. Bluetooth TM uti- 
lizes several layers of security. At a link level, remote/ 
local device authentication is required before any com- 
munication can take place. At the Channel level, a link 
level connection occurs and then the devices need to 
authenticate before a communications channel is estab- 
lished. Additionally, the data payload being transmitted 
may be encrypted. In this embodiment, appropriate se- 
curity at several protocol layers is utilized including the 
application layer. 

[0033] In an alternative, the pen includes audio input/ 
output including synthesized voice output and voice rec- 
ognition. Visual output is provided using an LCD display 
and LEDs and tactile feedback is provided using servo- 
mechanisms. Physical input includes an input button. 
[0034] The connections between the pen (not shown) 
and the processor (not shown) could be over private 
lines or may be a Virtual Private Network. It is contem- 
plated that all of the connections utilize appropriate se- 
curity measures. 

[0035] Other well-known input devices, servers, proc- 
essors, networks and communications mechanisms 
may be used. The back-end application (not shown) is 
utilized to process pen strokes. The back end applica- 
tion then recognizes form identification strokes in box 
1 1 0 to identify the fomn so that it can attribute the other 
strokes with the particular form template. In an alterna- 
tive, pen strokes are stored until the form is identified. 
[0036] The data written by a user in a particular data 



input flied can be rasterized and then subjected to Op- 
tical character recognition (OCR) in order to identify the 
data written by the user. 

[0037] The present embodiment may alternatively 

5 use any pen or stylus like device that provides for elec- 
tronically recording strokes. Position information may be 
processed into strokes or transmitted in a separate data 
stream. 

[0038] Here, the digital pen system utilizes a pen and 

10 system that can continuously track the movement and 
location of the pen and record pen stroke data. Some 
pen stroke data may be buffered in the pen before the 
data is sent to the back end application . The pen system 
can wirelessly transmit orstore and transmit tracking da- 

f5 ta in the pen stroke data. The digital pen can submit the 
form to the back end application as a transaction. The 
form generator includes a form serial number on the pa- 
per form being distributed for use by the authors. Each 
form type has a different serial number that is preferably 

20 pre-printed on the form using a traceable font having 
dashed lines as shown in 1 1 0. When the user traces the 
form serial number, the back end application receives 
the information and recalls a form template and other 
data in order to process the pen strokes. 

25 [0039] Referring to FIG. 1 B, a exploded view of a por- 
tion of form 1 00 is shown. In this embodiment, the form 
number 110 is located in box 111 and is printed in a 
dashed outline font. A user will then be able to trace over 
the characters and know what characters have been 

30 traced over by detemnining which have been filled in. 
[0040] Referring to FIG. 2, a schematic representa- 
tion of a data structure stored by the back end applica- 
tion on the processor (not shown) is described. Here, 
the preprinted form 100 has several field names such 

35 as the serial number 1 1 0 that is associated with the data 
structure 200 as serial number 210 having a field type 
222 and a field location 224 that defined the two dimen- 
sional space on the form dedicated to that field. The data 
structure has columns including thefield name 210, field 

40 type 212 that defines a data type and field location 214 
that defines a two dimensional space for the item on the 
form. The serial number has associated fields 220, 222, 
224. The Applicant name is associated with fields 230, 
232, 234. The Address is associated with fields 240, 

45 242, 244. The City is associated with fields 250, 252, 
254. The Zip Code is associated with fields 260, 262, 
264. The Social security number is associated with 
fields 270, 272, 274. The Applicant signature is associ- 
ated with fields 280, 282, 284. The Date is associated 

50 with fields 290, 292, 294. 

[0041] The form generator will generate the fonn tem- 
plate when creating the form and will associate the tem- 
plate and related data with a particular form serial 
number. The serial number fomn can be placed any- 

55 where on the fomri when it is created, but it is preferably 
placed near the top of the fonn. In some uses of the sys- 
tem, the serial number is traced first. However, the pen 
or back end system could store stroke data until the form 
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serial number is parsed and tlien process the stroke da- 
ta in accordance witli the recalled tennplate. The fornn 
template is preferable used to generate and print the 
copies of the form that are to be used. 
The forms may be made available in the form of a com- 
puter file that can be printed and then used with a digital 
pen. 

[0042] Supplemental text 112 instructs the user in 
tracing the serial number 1 1 0 on the form 1 00. The dig- 
ital pen may transmit pen stroke data to the back end 
application while it is being written . Alternatively, the part 
oral! of the transaction of filling in the form may be stored 
in a buffer in the digital pen and later transmitted to the 
back end application for processing. 
[0043] The back end process may then process the 
completed form as a transaction. The back end process 
can then locate the serial number field in the data and 
extract the serial number using a character recognition 
technique such as Optical Character Recognition 
(OCR). In this scenario, the back end application need 
not detect the characters of all of the stroke data and 
may use the template to apply the strokes as graphical 
information rather than live detected text. In an alterna- 
tive, all or some of the rest of the stroke data may be 
recognized using an OCR algorithm. 
[0044] In an example using a serial number that is not 
placed in a particular, location of the form, the serial 
number may be pre-printed using a particular font in a 
traceable format that the back end process is pro- 
grammed to detect. Similarly, a specific number of char- 
acters may be assigned to the serial number or a control 
string of characters could be used that is not likely to 
appear in a normally filled in fomn. Additionally, non-al- 
phanumeric characters such as special characters or 
symbols may be used to enablethe back end application 
to recognize the unique form indicator or serial number. 
In such situations, the back end application could scan 
all of the stroke data or some data that meets certain 
font or other guidelines while comparing that detected 
text to a lookup table of valid serial numbers in order to 
properly associate a template to the form 
[0045] Referring to FIG. 3, a process for identifying a 
form template is described. The process beings in step 
305 and the form processor receives and stores pen 
stroke input data in step 31 0. Here, the pen stroke data 
may be a data feed in the wireless channel or data sent 
from a paired device such as a cellular phone that stores 
some stroke data and then communicates it through the 
Internet to a form processor. In step 320, the form proc- 
ess 300 determines if the form type serial number has 
been determined. If the form is not identified, the proc- 
ess returns to step 310 to receive additional pen stroke 
data. If the form is identified, the process proceeds to 
step 330 to parse the input and any commands and data 
as expected from the form template. The process 300 
continues to process the form data in step 340 until the 
process is completed in step 399. The back end appli- 
cation may check for an end of form indication such as 



the use of the signature block or the lapse of a certain 
period of time in the user input stream. 
[0046] Known systems such as C++ or Word and VBA 
may be utilized for a back end application. The Anoto 
5 toolkit may be utilized. The authentication data may be 
used to ensure that only authorized users have access 
to the forms and data. 

[0047] In an alternative applicable to any of the em- 
bodiments described, the form processor can use the 

pen stroke data and pen identification data to determine 
if the salesman or user has authority to use the particular 
form. 

[0048] In any of the described embodiments, error in- 
dications or messages may be communicated using 
LED indicators, a display such as an LCD display or au- 
dio indications such as beeps or synthesized speech us- 
ing a speaker. Additionally, tactile feedback may be uti- 
lized to indicate an error condition or provide other feed- 
back such as an indication that a form was successfully 
identified and completed. 
[0049] The present application describes illustrative 
embodiments of a system and method for composing 
documents using a pointing device and in one embodi- 
ment describes a digital pen system for detecting a form 
version using a digital pen. The embodiments are illus- 
trative and not intended to present an exhaustive list of 
possible configurations. Where alternative elements are 
described, they are understood to fully describe alterna- 
tive embodiments without repeating common elements 
whether or not expressly stated to so relate. Similarly, 
alternatives described for elements used in more than 
one embodiment are understood to describe alternative 
embodiments for each of the described embodiments 
having that element. 

[0050] The described embodiments are illustrative 
and the above description may indicate to those skilled 
in the art additional ways in which the principles of this 
invention may be used without departing from the spirit 
of the invention. Accordingly, the scope of each of the 
claims is not to be limited by the particular embodiments 
described. 



Claims 

45 

1. A method for processing form input data compris- 
ing: 

capturing user stroke data relating to strokes 
50 made by a user with a pointing device; 

processing the strokes in order to determine 
form identification data; 
retrieving a form template using the form iden- 
tification data; 

55 processing the form input data using the form 

template and the user stroke. 

2. The method of claim 1 wherein the pointing instru- 
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ment is a digital pen and strokes are provided by 
the user writing on a paper form. 

3. The method of claim 2 further comprising: 

processing a pre-determined portion of the 
strol<e data to determine the form identification 
data. 

4. The method of claim 3 wherein: 

the pre-determined portion of the strol<e data is 
related to a pre-detennined physical portion of 

the form. 

5. The method of claim 2 wherein: 

processing stroke data that satisfies pre-deter- 
mined criteria to determine the form identifica- 
tion data. 

6. The method of claim 5 wherein: 

the pre-determined criteria includes font crite- 
ria. 

7. The method of claim 2 wherein the form identifica- 
tion data includes a form serial number printed on 
the form. 

8. The method of claim 7 wherein the form serial 
number printed on the form includes a dashed font. 



processing a pre-determined portion of the 
stroke data to determine the form identification 
data. 

5 12. The method of claim 11 wherein: 



the pre-determined portion of the stroke data is 
related to a pre-determined physical portion of 
the form; and 

the form identification data includes a form se- 
rial number printed on the form. 
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13. The system of claim 12 wherein the form serial 
number printed on the form includes a dashed font. 

1 4. The system of claim 1 0 further comprising the proc- 
essor operative with the logic program to perfonn: 

processing stroke data that satisfies pre-deter- 
mined criteria to detennine the fonn identifica- 
tion data. 

15. The system of claim 14 wherein: 

the pre-determined criteria includes font crite- 
ria. 



9. A system for composing a facsimile comprising: 

a processor; 

a storage device connected to the processor; 
the storage device storing a logic program; 
the processor operative with the logic program 
to perform: 



35 



40 



capturing user stroke data relating to 
strokes made by a user with a pointing de- 
vice; 

processing the strokes in order to deter- 45 

mine form identification data; 

retrieving a form template using the form 

identification data; and 

processing the form input data using the 

form template and the user stroke. so 



10. The system of claim 9 wherein the pointing instru- 
ment is, a digital pen and strokes are provided by 
the user writing on a paper form. 

1 1 . The system of claim 1 0 further comprising the proc- 
essor operative with the logic program to perform: 
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